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« The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- tf the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )IS Responsive to cx)mmunication(s) filed on 09 December 2004 . 
2a)D This action is FINAL. 2b)(3 This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1, 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-23 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) E3 Claim(s) 1^23 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) Q The specification is objected to by the Examiner. 

10) [3 The drawing(s) filed on 16 August 2001 is/are: aM accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

11) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. Q Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 
Response to Amendment 

1 . In response to the office action from 1 1/30/2004, the applicant has submitted a request 
for continued examination, filed 12/9/2004, amending the Claims 1, 8, and 15, while adding 
Claims 22-23 and arguing to traverse the art rejection based on the limitations regarding the 
evaluation of contexts based upon an access characteristic, the reception of a representation of a 
spoken utterance that includes a command that is able to be associated with multiple 
applications, and the launching of a selected speech application as needed and subsequently 
performing the command function (Amendment, Page 6). The applicants' arguments have been 
fully considered but are moot with respect to the new grounds of rejection in view of Grant et al 
(U.S. Patent: 6,208,972). 

Claim Rejections - 35 USC §103 

2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

3. Claims 1-23 are rejected under 35 U.S.C. 103(a) as being unpatentable over 



Balakrishnan (U.S. Patent: 6, 233, 559) in view of Grant et al (U. S. Patent: 6,208,972). 
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With respect to Claims 1, 8, and 15, Balakrishnan discloses: 

A method, device, and computer useable medium (Col 5, Lines 41-55) for determining a 
speech-enabled application to receive a spoken utterance in a multi-context speech enabled 
environment comprising the steps of: 

Evaluating a plurality of contexts for speech-enabled applications based upon an access 
characteristic, said evaluating being applied to speech enabled applications whether the 
application is running or not (context-dependent arbitrator that gives higher speech command 
priority to an in-focus application, except for commands such as "start" or "open, " which 
would be directed to an out-of-focus application, wherein an out-of-focus application also 
includes an application that is not running, Col 4, Lines 38-67)\ 

Receiving a representation of a spoken utterance, the spoken utterance including a 
command that is able to be associated with multiple applications (digitizing a speech input from 
a microphone and extracting features, Col 4, Lines 18-21, and "start" and "open" commands, 
Col 4, Lines 38-67); and 

Directing the representation of the spoken utterance to a selected speech enabled 
application based upon results of the step of evaluating the contexts (directing a speech 
command to a particular application based upon a confidence level relating to context, Col 4, 
Lines 52-58). 

Balakrishnan does not specifically suggest that a speech command applied to a selected 
speech enabled application includes launching the selected speech enabled application as needed 
and performing a function of the command, however Grant recites such a method (Col 8, Lines 
45-51, Col 9, Lines 18-46, and Fig. 7, Elements S704-S706, andS800). 
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Balakrishnan and Grant are analogous art because they are from a similar field of 
endeavor in speech controlled computer applications. Thus, it would have been obvious to a 
person of ordinary skill in the art, at the time of invention, to combine the teachings of 
Balakrishnan and Grant to provide a more efficient means of operating a speech enabled 
computer interface by eliminating the need to utter multiple commands to perform a desired 
application task through the use of a single command phrase (Grant, Col, 2, Line 57- Col. 3, 
Line 3). 

With respect to Claims 2, 9, and 16, Balakrishnan recites: 

Prior to evaluating the contexts, a step of creating the contexts for the speech enabled 
applications in the speech-enabled environment (created contexts based upon a focus state of a 
speech enabled application (foreground or background) utilized by an arbitrator to 
appropriately direct a speech command, Col. 4, Lines 52-57. Furthermore, in order for the 
arbitrator to utilize the contexts, it would be inherent that there must have been some prior step 
of context creation to define the context states (foreground and background)). 

With respect to Claims 3, 10, and 17, Balakrishnan discloses: 

Identifying each context based on a persistent grammar (vocabulary that would be valid 
for all context states such as 'quit, " Col. 4, Line 62), a foreground grammar (vocabulary 
appropriate when a command would be active, such as edit, that would be directed to an 
application in the foreground, Col. 4, Lines 52-67), or a background grammar (vocabulary that 
would be associated with a background application such as "start" or "open, " Col 4, Lines 45- 
51) for each speech enabled application. 
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Balakrishnan further discloses a context-dependent arbitrator capable of distinguishing 
between different types of commands to identify a particular focus state and determining a 
confidence level indicator, based upon the focus state, in order to distribute a speech command to. 
an appropriate application. 

With respect to Claims 4, 11, and 18, Balakrishnan discloses: 
The step of evaluating contexts comprises prioritizing the contexts based on the access 
characteristic (context-dependent arbitrator that gives priority to an application based upon a 
foreground or background focus state, Col 4, Lines 52-58). 

With respect to Claims 5, 12, and 19, Balakrishnan recites: 

The access characteristic is based on recency of relevant access to the context (arbitrator 
that assigns a higher confidence score to an active and most current application in a foreground 
context state, Col. 4, Lines 52-58). 

With respect to Claims 6, 13, and 20, Balakrishnan discloses: 

The step of directing the representation of the spoken utterance to the one of the contexts 
comprises using a grammar to identify and select a context of the selected speech enabled 
application (application-specific vocabularies, which define acceptable commands, Col 4, Lines 
1-17, that enable a context-dependent arbitrator to identify and direct a speech command to a 
particular application in a foreground or background context, Col, 4, Lines 38-67). 

With respect to Claims 7, 14, and 21, Balakrishnan in view of Grant teaches the 
application specific vocabularies (grammars), which determine acceptable commands, that 
enable a context-dependent arbitrator to identify and direct a speech command to a particular 
application in a foreground or background context, as applied to Claims 6, 13, and 20. 
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Balakrishnan does not teach the use of a Backus Naur form grammar, however, it would have 
bee an obvious matter of design choice to utilize a Backus Naur grammar to define acceptable 
speech commands for a particular application context, since the applicant has not disclosed that 
utilizing a Backus Naur grammar form is for any particular purpose and it appears that speech 
commands could be sufficiently identified as being associated with a particular application 
context with an alternate grammar form. 

With respect to Claim 22, Balakrishnan discloses: 

Evaluating a plurality of contexts for speech-enabled applications based upon a recency 
of access characteristic context (arbitrator that assigns a higher confidence score to an active 
and most current application in a foreground context state, Col 4, Lines 52-58); 

Receiving a representation of a spoken utterance, the spoken utterance including a 
command that is able to be associated with multiple approaches (digitizing a speech input from a 
microphone and extracting features, Col. 4, Lines 18-2 1, and "start" and "open" commands, 
Col 4, Lines 38-67); and 

Directing the representation of the spoken utterance to a selected speech enabled 
application based upon results of the step of evaluating the contexts (directing a speech 
command to a particular application based upon a confidence level relating to context, Col 4, 
Lines 52-58). 

Balakrishnan does not specifically suggest that a speech command applied to a selected 
speech enabled application includes launching the selected speech enabled application as needed 
and performing a function of the command, however Grant recites such a method (Col 8, Lines 
45-51, Col 9, Lines 18-46, and Fig. 7, Elements S704-S706, andS800). 
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Balakrishnan and Grant are analogous art because they are from a similar field of 
endeavor in speech controlled computer applications. Thus, it would have been obvious to a 
person of ordinary skill in the art, at the time of invention, to combine the teachings of 
Balakrishnan and Grant to provide a more efficient means of operating a speech enabled 
computer interface by eliminating the need to utter multiple commands to perform a desired 
application task through the use of a single command phrase (Grant, Col. 2, Line 57- Col. 3, 
Line 3). 

With respect to Claim 23, Balakrishnan further discloses: 

Directing is biased to the most recently accessed application (arbitrator that assigns a 
higher confidence score to an active and most current application in a foreground context state, 
Col 4, Lines 52-58). 

Conclusion 

4. The prior art made of record and not relied upon is considered pertinent to applicants 
disclosure: 

Douglas (U.S. Patent: 5,812,977)- teaches the initiation of a subroutine and task using a 
speech input. 

De Armas et al (U.S. Patent: 5,873,064)- discloses a single speech command that ■ 
initiates a series of actions. 
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5. 



Any inquiry concerning this communication or earlier communications from the 



examiner should be directed to James S. Wozniak whose telephone number is (703) 305-8669 
and email is James.Wozniak@uspto.gov. The examiner can normally be reached on Mondays- 
Fridays, 8:30-4:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Doris To can be reached at (703) 305-4827. The fax/phone number for the 
Technology Center 2600 where this application is assigned is (703) 872-9306. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the technology center receptionist whose telephone number is (703) 306- 
0377. 



James S. Wozniak 
3/3/2005 




